Multimodal spatial querying: what people sketch and talk about
نویسندگان
چکیده
People want to use geographic information systems (GISs) while spending little time for learning how to use the system. This trend increases the need for easy-to-learn and intuitive user interfaces. In order to make GISs easier to use for untrained users, we investigate an interaction method that mimics the natural communication between people and allows users to formulate queries. In human-human interaction people often communicate about space by talking and simultaneously drawing a freehand sketch; therefore, this combination of modalities is attractive for describing spatial scenes when querying a GIS. To assess the usefulness of this approach, we have conducted a human-subject experiment in which subjects were asked to draw spatial queries and talk at the same time. We analyzed what modality subjects preferred when they had the choice of sketching and talking. We found that subjects gave complementary information through the two modalities, indicating that sketching cannot replace the verbal descriptions, and vice versa. We also found redundant information in both modalities, which provides a solid foundation for integrating elements from the two modalities.
منابع مشابه
Developing a BIM-based Spatial Ontology for Semantic Querying of 3D Property Information
With the growing dominance of complex and multi-level urban structures, current cadastral systems, which are often developed based on 2D representations, are not capable of providing unambiguous spatial information about urban properties. Therefore, the concept of 3D cadastre is proposed to support 3D digital representation of land and properties and facilitate the communication of legal owners...
متن کاملAll It Takes for Corruption in Health Systems to Triumph, Is Good People Who Do Nothing; Comment on “We Need to Talk About Corruption in Health Systems”
Numerous investigations demonstrate that the problem of corruption in the health sector is enormous and has grave negative consequences for patients. Nevertheless, the problem of corruption in health systems is far from eminent in the international health policy debate. Hutchinson, Balabanova, and McKee have identifed in their Editorial five reasons why the health policy community has been relu...
متن کاملHigh Stakes Require More Than Just Talk: What to Do About Corruption in Health Systems; Comment on “We Need to Talk About Corruption in Health Systems”
Reluctance to talk about corruption is an important barrier to action. Yet the stakes of not addressing corruption in the health sector are higher than ever. Corruption includes wrongdoing by individuals, but it is also a problem of weak institutions captured by political interests, and underfunded, unreliable administrative systems and healthcare delivery models. We ur...
متن کاملVisual Languages for Spatio-temporal Applications
Then, for querying and manipulating, several languages will be presented, namely SKETCH, CIGALES for spatial querying, and LVIS for spatio-temporal querying and manipulating. For instance LVIS has some interesting mechanisms for describing spatio-temporal criteria by means of an anchor/balloon mechanism. By nature, visual queries can sometimes present ambiguities: some solutions to solve this p...
متن کاملSpatial-Query-by-Sketch
Today’s methods for interacting with geographic information systems (GISs) and geographic databases are primarily aspatial, as they require users to deal with geographic data primarily through alphanumeric command languages. Spatial querying by typing a command in some spatial query language or by selecting the same syntax from pull-down menus is a tedious process, because it often requires ext...
متن کامل